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A multi-dimensTonal : ne^iis^rsse^^mefl^-model h a s bee n 

developed to provide a research tool for the review of statewide 
curriculum needs in vocational education. The model provides for an 
integrated review of selected demographic, educational, and 
decision-making data to target vocational education program areas and 
occupational titles for additional research and development' while 
also reflecting the social, economic, and technological elements of 
society that impact on vocational education. It consists of five 
sequential parts with data categorized according to their distinctive 
sources. Six weighted community-based variables and 15 unweighted 
school-based variables are included in the model. Community-based 
data are collected through a two-stage DELPHI survey from selected 
state and federal data bases. School-based data are collected through 
site visits to vocational schools by research teams using a 
specifically designed curriculum rating schedule. The five parts of 
the model are (1) decision-making factors, (2) a DELPHI review 
(determination, of those occupational titles in a vocational education 
program area likely to be most important during a projected 5-year 
period), (3) demographic importance (collection and application of 
state and federal data), (4) educational need (review of selected 
curriculum materials), and (5) a decision-assisting review. (YLB) 
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4. O 

Introduction 

The model described in this paper was developed through funds provided 
by the New Jersey State Department of Education, Division of Vocational Educa- 
tion and Career Preparation as part of a sustained research and development 
effort conducted at the New Jersey Vocational-Technical Curriculum Laboratory, 
Rutgers University. 

The model was formatively developed during the first stage of the State- 
wide Curriculum Development Project. Specific project goals included the iden- 
tification of vocational education program areas and occupational titles likely 
to be most important during a projected five year time period; the formulation of 
~~ a-cgnso T4da t ed-amt- cos t ■ o f f o ct t ve approach to th e development o txurrl£iilijm 

materials for targeted vocational program titles in areas reviewed; and the 
design and implementation of a summative evaluation system for products developed. 

Overall project goals of the Statewide Curriculum Development Project will 
be achieved through a sequence of fi ve^evelopmental stages. These include: 
Stage One, Needs Assessment; Stage Two, Curriculum Development; Stage Three, 
Field Testing and Formative Evaluation; Stage Four, Dissemination and Utiliza- 
tion; and Stage Five, Summative Evaluation. 

Curricular Influences 

Economic, technological and social changes have had a significant in- 
fluence on the delivery of vocational education ?nd the subsequent demands on 
curricular needs in recent years. Further, these change elements have had an 
affect on all considerations associated with the decision-making process used 
in the allocation of resources to meet educational objectives. 

Domestic inflation has exhibited an ever increasing spiral growth pattern 
on the economy since the beginning o'f-the United States involvement in Viet Nam. 
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Demands for reductions in the use of public funds for education and dramatic 
increases- in the cost of energy further compounds this already critical economic 
situation. . 

Contemporary technological growth has been. a major influence on the content 
of vocational education curriculum during the past few decades. Further, an 
accelerated technological growth pattern in the future is certain. The frequency 
of the number of innovations, the rate at which these innovations occur, the re- 
duced period of time required for the infusion of these innovations into society 
as well as the influence which one innovation might have on the creation of a new 
innovation all contribute to the demands of preparing skilled entry level workers. 

The civil liberties of all individuals in every aspect of American life have 
received profound attention during the last twenty years. A host of Federal 
Statutes and regulatory measures have been instituted to insure the educational 
rights of all persons seeking occupational entry regardless of their racial, 
sexual, cultural, physical, economic, emotional or intellectual background. 

As an integral element of society, vocational education is directly influenced 
by the forces of economic, technological and social change. Through its dynamic 
role in society, vocational education has the distinction of also providing direct 
influence to these very same .forces. Thus, a symbiotic relationship is identified 
which requires a continuous and interrelated growth mode if optimum benefit is to 
be expected. The collection and processing of data required for decision-making 
in vocational education is therefore complex as an activity and far reaching in 
its impl ications . 

Description of the Model 

Due to the complexity of our contemporary society, the development of a 
multi-dimensional needs assessment model was undertaken in order to provide a 



research tool for the review of statewide 'curriculum needs in vocational educa- 
tion. Considerations incorporated in this model contributed to the utilization 
of an array of selected demographic, educational and decision-making dataf 
The model provides for an integrated review of these data in order to target 
vocational education program areas and occupational titles/ for additional re- 
search and development as outlined in the remaining states of the project. Fur- 
thur, this mul ti-dimensioqal needs assessment model reflects the social, econ- 
omic and technological elements of society which impact on the vocational educa- 
tion community. t 

r 

Specific outcomes of this model include: (1) vocational education program 

c. 

areas and specific titles with the greatest statewide need, (2) a weighted 
set of decision-making factors used in the allocation of vocational education 
resources , ^(3) a listing of demographic data for selected vocational education 
program areas and specific titles , (4) a descriptive profile of curriculum 
materials in selected vocational education program areas and specific titles 
currently in use throughout the state, and (5) a listing of the primary text- 
books which are being used in selected vocational education program areas and 
'specific titles throughout the state. 

The needs assessment model may also be applied to municipal, county and 
regional settings for curricular decision-making. Data and findings of this 
model also aid the decision-making process for long range policy planning, 
facility development and space utilization. 

Application of the Model 

The New Jersey Statewide Curriculum Needs Assessment Model consists of 
five sequential parts with data categorized according to their distinctive 
sources. Six weighted community-based variables and fifteen unweighted school- 
based variables are included in this model. During application, community- 



based data are collected from selected State and Federal data bases- School - 
based data are collected through site visitations to vocational schools by re-, 
search teams using a curriculum rating schedule designed specifically for this 
activity. All data are mathematically interfaced to provide a rank-ordered 
listing of program titles based on calculated statewide need, A State level 
executive decision-assisting review of empirical findings and recommendations is 
the final element of this model. A detailed explanation of the procedures fol- 
lowed during each of the model's five parts will be presented during the re- 
mainder of this section. 
Part I: Decision-Making Factors 

FoMowing discussion by members of a project advisory committee, a survey 
instrument including seven factors associated with the allocation of vocational 
education resources was developed. The mean weighted assignments given to these 
factors by a population of County Career Education Coordinating Council members 
in Mew Jersey (N=122) is included irfr Table 1. 

Table 1 

Weight Assignments Given to Decision-Making Factors ' 



Decision-Making Factors 


Mean 
(Weiqhts) 


S.D. 


Job Market Demand (JMD) 


28.85 


12.99 


Enrollment (ENROLL) 


.20.81 


16.38 


Placement Figures (PLACE) 


j 17.59 


11.09 


Typical" Job Earnings (WAGE) 


10.71 


9.25 


Mo. of Disadvantaged Enrolled (DIS) 


8.65 


8.25 


No. of Handicapped Enrolled (HAND) 


8.63 


8.08 


No. of Limited English- Proficient Enrolled 

(LIM-ENG) 


4.82 


4.80 



4 



6 



It should be noted that other decision-making factors could be used for 
weight assignments in future replication of the model.. It is expected that, 
factors affecting the allocation of resources for vocational education will 
change due to shifts in legislation, funding and social policy. 
Part II: A DELPHI Review 

*■ An optional two-stage DELPHI survey element is included to determine, which 
specific occupational titles in a vocational education program area are likely 
to be most important during a five year projected time block. The first DELPHI 
section includes an open response format. The second instrument utilizes titles- 
which received the greatest frequency of responses from the first instrument, 
i.e. 1 S.D. above the mean. Respondents to the second DELPHI instrument rate 
titles listed according to their likely importance during the same projected 
time period using a five point Likert scale. The occupational titles with the 
highest ratings, i.e.; 1 S.D. above the mean, from the second DELPHI survey are 
utilized later in the collection and application of data in the remaining parts 
of the model. It should be noted that depending upon the volume of titles to 

a 

be considered, this part of the model may be considered as optional. 
Part III: Demographic Importance 

This part of the model involves the collection and subsequent application 
of selected data from State and Federal sources to calculate demographic impor- 
tance scores for the vocational education program specific titles identified. 
The six weighted decision-making factors are mathematically applied- to this data. 

In outline form, the first three parts of the model are applied in the 

following manner: ^ 

1. Identify decision-making factors and determine their weighted 

k values.* 

(V V W 3, W 4, W 5, W 6, W 7>* 
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2. Collect raw communi ty .and school based demographic data for 
each program specific title, 

3. Normalize the demographic data within each vocational education 
program area by dividing the largest number into the remaining 
numbers in each decision-making factor category. The resulting 
normalized data will "have a range from 1.00 to 0.00. 

(A 1, A 2, A 3, A 4, A 5, A 6, V 

4. Calculate the Demographic Importance Scores (DIS) for each 

program specific title by multiplying the normalized data by 
the weighted value and summing across. 
DIS = (U^A,) + (W 2 A 2 ) + (W 3 A 3 ) + (W 4 A 4 ) + (W g A g ) + 
(W 6 A 6 ) + (W ? A ? ) 

♦Decision-making factor weights which were utilized during the formative de- 
velopment of this model: 

W 1 = 28.85 (Job Market Demand) 

W 2 = 20.81 (Enrollment) ' 

W 3 = 17.59 (Placement Figures) 

W^" ■ -10.71 (Typical Job Earnings) 

= 8.65 (No. of Disadvantaged Enrolled) 

Wg = 8.63 (No. of Handicapped Enrolled) 

Wj = 4.82 (No. of English-Proficient Enrolled) 
Part IV: Educational Need 

The fourth part serves to review selected curriculum materials in use through- 
out the state using a set of .fifteen standards reflecting the generic elements of 
competency-based vocational education as well as considerations appropriate to 
special student populations through the use of a curriculum rating schedule de- 
veloped specifically for this activity. A copy of this rating schedule is in- 



eluded on the following page. Curriculum 'materials consisting of courses of 
study, lesson plans, course texts and instructional supplements are reviewed by 
research team members during on-site visitations. Data collected are converted 
to discrepancy scores by subtracting akual ratings from maximum rating values 
(4.0) and then averaging -these in order to calculate educational need scores. 

The demographic importance scores developed in the third part of the proce- 
dure are subsequently interfaced with the educational need scores from the fourth 
part of the procedure in order to facilitate the development .of a rank ordered 
listing of vocational education program titles with the highest calculated 
statewide need. 

In outline form, the educational need scores are calculated for the specific 
occupational titles identified in the demographic importance part of the model 
using the following procedure: < 
1. Collect raw data in each of the fifteen curriculum 

characteristic areas included on the research, instrument. 
■ 2. Determine the mean rating of each curriculum characteristic 
area for program specific titles reviewed. 
3. Calculate the educational need score by subtracting the 
combined mean rating of each curriculum characteristic 
within a program area from the perfect value rating used 
in the instrument (4.0). 
A computational illustration of all data collected during the first four 
parts of the model as /it is mathematically interfaced is provided in Table 2. 
Part V: A Decision-Assisting Review 

A rank ordered listing of findings based on calculated statewide need in a 
particular program area serves as a vehicle to'initiate the final part of the 
model, an executive level decision-assisting review. 
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CURRICULUM RATING SCHEDULE V. 
New Jersey Statewide Curriculum Development Project 

Program Title ' VEDS No, Level of Delivery PS 

NUMERICAL VALUE 

1 _2 .3 4 

0 - 20% 21 - 502 51 - 80% ' 81 - 1002 

PERCENTAGE OF CHARACTERISTIC 

1." The materials contain objectives which include conditipns , performances and criteria. 

2. The materials contain a system for evaluating students' performances, including tests' 

and/or performance checklist that directly measure mastery of the objectives. 

» 

3. The content covered in the materials is current and includes all the necessary know- 
ledge-, skills and attitudes. r 

^. 

4. The materials ate free of sex bias. 

5. The materials are accompanied by adequate instructor management information such as 

~~ record-keeping forms, course sequencing, and directions for implementation. 

6. The materials are structured well enough and provide enough student directions to 

facilitate open-entry/open-exit, self-pacing and individualization. 

7. The materials are organized to permit a progression of employable skill development 

throughout the entire program. 

8. The Materials are designed to facilitate integral record-keeping in relation to the 
Individualized Educational Program (IEP) . 

9. The materials contain a system for continuous formative evaluation that facilitates 
communication with the I.E. P. Team'. 

1 0. the materials contain prerequisite levels of cognitive, psychomotor, affective and 
" perceptual skills necessary for successful entry into each instructional unit. 

9 

11. The materials provide for prescriptive teaching techniques, alternative instruc- 

~~ tional materials, and individualized student learning activities that lend them- 
selves to disparate learning styles. 

12. The materials have been field-tested with normal populations. ,> 

13. The materials have been field-nested with handicapped populations. 

14. The materials have been field-tested with disadvantaged populations. 

15. The materials hajre been field-tested with gifted populations. 

* (Author) " (Title) (Copyright) 
Origin of Curriculum Materials: . 



(date of origin - revision) 

COMMENTS: ' 
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TABLE 2 . 

COMPUTATIONAL* DATA BASE FOR VOCATIONAL INDUSTRIAL &)UCAJION: 

SECONDARY LEVEL 



PROGRAM SPECIFIC 
TITLE 



OE/VBDS 
Code No. 



JMD 



ENROLL 



PLACE 



RAW DATA C 
WAGE-, 



DIS 



HAND 



LIM-ENG 



Auto Mech 


j t \ • 
17.0302 1 


1,337 


2.9A8 


222.00 


78 


771 


139 




• 


i > 

). 


f f 


Diesel Mech 


17.1200 


608 


A75 


222.50 


10 




J. 3 




• * 






Electron les 


w 17.1500 


A75 


730 


29A.25 

> 


9 


198 


39 


» 
/ 


V 




Solar Cluster 00 




396 


32A 


383.73 


5 * 


77 






_ 






1. Plumb & Pipe 


IT 1 AA7 

1/ • llKJ / 


670 


' 323 


A55:19 


6 


71 


• 16^ • 










z. tLeccrxcai 


17 1 A (10 


218 


586 


— - 3AO.60 


-°6 


152 


I 


* » 




) # 


3. Stationary Eng. 


17.3200 


302 


65 


356.00 


3 


9 


1 




• 




# 


Scl Data Proc 


16.0117 


A 05 


25 


357.30 




1 


0 


















NORMALIZED DATA 






























t 


Demographic 


Educ . 






















Importance 


Need 










W(28.85) W(20.81) 


— W(lGf.71) 


W(8.65) 


W(8.63) 


W(A.82) 


Score 


Score* 


Total 


Rank 


Auto Mech 


17.0302 


1.00 


1.00 


~ .57 


1.00 


1.00 


1.00 


77.86 


1.7A 


135. A8 


1 4 


Diesel Mech 


17.1200 


• A5 


.16 


— .57 


.13 


.1A 


.02 *~ 


24. &3 


2.22 


55.12 


2 


Electronics 


17.1500 


.35 


.25 


.77 . 


.12 


. .26, 


*. .28 


28.17 


1.7A 


A9.02 


a' • 

t 


Solar Cluster (XV 




.30 


.11 


\— ' 1.00 J ■( .06 


.10 


. .06 


23.33 


-2.21 


51.56 


3 .'- 


1. Plumb & Pipe 


17.1007 






, . ^ 














"' / • 


2. Electrical 


17.1400 , 






















3. Stationary Eng. 


17.3200 






















Scl Data Proc 


16.0017 


.30 


.01 


.93 


. 0 


.001 


0 


. 18. 8A 


2.18 


Ai.07 


5 


^ 












> 


■ ■ ■. if 
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A distinction'should be noted between the decision-assisting approach 
chosen for o the -final stage of the model and the more common decision-making 
activity associated with data application. Data and findings of a research 
activity can be applied directly to decision-making per se or they can be 
reviewed and synthesized with other information and considerations as an aid 
to derision-making. The decision-assisting approach was chosen over the 
decision-making approach for utilization in the model for two primary reasons. 
First, it provides the flexibility necessary to introduce important considera- 
tions which were- not possible to include in a quantifiable manner. Secondly, 
it provides an opportunity to introduce timely information that was unavailable 
or unknown earlier. Further, the decision-assisting approach has been compared 
to a fail-safe concept which can be used to insure the achievement of previously 
identi fied goals . 

Summary and Conclusion 
Six weighted community-based variables and fifteen unweighted school-based 
variables are included in th^s multi-dimensional model. Community-based data 
are collected through a two .^^age DELPHI survey and from selected State and 
/ Federal data bases. School -based data are collected through site visitations to 
vocational schools by research teams using a curriculum rating schedule designed 
specifically for this activity. All data are mathematically interfaced to pro- 
vide a rank-ordered listing of program titles based on calculated statewide need, 
A State level executive decision-assisting review of empirical findings and 
recommendations is the final element of this model. 

The statewide curriculum needs assessment model developed is significant 

in that it provides a systemic approach to the consideration of a host of 

* 

variables affecting curricular decisions in vocational education. A di'stin- 
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guishing feature of this model is its ability to react to all program areas of 
vocational education in an equal fashion, further, the overall findings of this 
model can also be applied to long range policy planning, facility development 
and space utilization. Specific components of the model such as the curriculum 
rating schedule, curriculum profile charts and such provide for additional 
independent application by persons- involved in curriculum review, validation 
and/or development. 



